Discrete Entropy Power Inequalities via Sperner Theory

نویسندگان

  • Mokshay M. Madiman
  • Liyao Wang
  • Jae Oh Woo
چکیده

A ranked poset is called strongly Sperner if the size of k-family cannot exceed the sum of k-largest Whitney numbers. In the sense of a function ordering, a function f is (weakly) majorized by g if the the sum of k-largest values in f cannot exceed the sum of k-largest values in g. Two definitions arise from different contexts, but they have strong similarities in their own meanings. Furthermore, the product of weighted posets has another similarity with the convolution of functions. Elements in the product of ranked and weighted posets capture structures of the building blocks in the convolution. Combining all together, we are able to derive various types of entropy inequalities and discuss their applications.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Information theoretic inequalities

The role of inequalities in information theory is reviewed and the relationship of these inequalities to inequalities in other branches of mathematics is developed. Index Terms -Information inequalities, entropy power, Fisher information, uncertainty principles. I. PREFACE:~NEQUALITIES ININFORMATIONTHEORY I NEQUALITIES in information theory have been driven by a desire to solve communication th...

متن کامل

Forward and Reverse Entropy Power Inequalities in Convex Geometry

The entropy power inequality, which plays a fundamental role in information theory and probability, may be seen as an analogue of the Brunn-Minkowski inequality. Motivated by this connection to Convex Geometry, we survey various recent developments on forward and reverse entropy power inequalities not just for the Shannon-Boltzmann entropy but also more generally for Rényi entropy. In the proce...

متن کامل

Seventh Workshop on Information Theoretic Methods in Science and Engineering

Shannon’s entropy power inequality characterizes the minimum differential entropy achievable by the sum of two independent random variables with fixed differential entropies. Since the pioneering work of Shannon, there has been a steady stream of results over the years, trying to understand the structure of Shannon’s entropy power inequality, as well as trying to develop similar entropy power i...

متن کامل

Evaluation of monitoring network density using discrete entropy theory

The regional evaluation of monitoring stations for water resources can be of great importance due to its role in finding appropriate locations for stations, the maximum gathering of useful information and preventing the accumulation of unnecessary information and ultimately reducing the cost of data collection. Based on the theory of discrete entropy, this study analyzes the density of rain gag...

متن کامل

Information Theory and Decision Tree

3 Basics of information theory 3 3.1 Entropy and uncertainty . . . . . . . . . . . . . . . . . . . . . . . 4 3.2 Joint and conditional entropy . . . . . . . . . . . . . . . . . . . . 4 3.3 Mutual information and relative entropy . . . . . . . . . . . . . . 5 3.4 Some inequalities . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 3.5 Entropy of discrete distributions . . . . . . . . . . . ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1712.00913  شماره 

صفحات  -

تاریخ انتشار 2017